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ABSTRACT 

To determine if the Convergence Planning Technique, 
designed to identify research components and organize them in a 
logical manner on a matrix for analysis, could be applied to 
vocational education problems in Wisconsin, questionnaires composed 
of problems identified through literature reviews and interviews were 
distributed to vocational, technical and adult education 
administrators and board members and the project's steering 
committee. Data obtained were used in the construction of a matrix 
which when analyzed revealed five phases necessary to constitute a 
suitable research design. These phases are: (1) identification and 
analysis of needs, (2) development of systems designs, (3) specified 
sub-systems research, (4) procedures for integrating sub-systems with 
the existing system, and (5) evaluation. It was concluded that the 
Convergence Technique could be employed in vocational research 
planning. (SN) 
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THE CONVERGENCE PROJECT: PROBLEM AND OBJECTIVES 

Summary 



This project was undertaken to determine if the Convergence Technique 
could be applied to vocational education problems in Wisconsin to obtain 
a valid research plan* The Convergence Technique was designed to provide 
a flexible planning system for research. It provides a process for ident- 
ifying the components of a research program and ordering them in a logical 
series of planning units which progress from general to very specific. 
Research activities are based on the logic or organization of the substan- 
tive area to be investigated. The research plan is graphically depicted in 
a matrix containing three major flows of activities and resources: 

(1) research; (2) information; and (3) resources. The three flows are 
correlated in the research matrix. 

Vocational educators were interviewed to determine critical problems 
in vocational education in Wisconsin. R.C.U. reports and additional 
literature were reviewed to isolate more potential problems. These 
problems were edited and used to construct the Research Problems Survey 
Form. This instrument was sent to administrators in Wisconsin vocational - 
technical schools; LVEC’s; Wisconsin Board of Vocational, Technical and 
Adult Education staff members; selected Department of Public Instruction 
staff members, and Steering Committee members. 

Major problems identified at the secondary school level related to 
developing career education programs and related instructional materials, 
designing effective vocational counseling programs, and identifying valid 
career decision-making procedures. In the post-secondary VTAE system, 
emphasis was given to research focused on techniques for determining the 
need for vocational programs; program, student and staff evaluation; 
identifying the cost/effectiveness of programs; and developing effective 
career education programs. 

The results of the survey were used in constructing a research 
matrix. This matrix was developed by a committee comprised of representa- 
tives from the VTAE system, LVEC’s, DPI and R.C.U. The matrix was reviewed 
and revised by the project’s Steering Committee. 

Five major phases were identified for the research matrix. The 
first phase is concerned with the identification and analysis of needs. 

Phase II focuses on the design of the systems required to attain the major 
goal of improved vocational education. Phase III specified research on 
sub-systems. Research procedures for implementing and integrating new 
sub-systems with the existing system are included in Phase IV. The last 
phase is concerned with evaluation. 
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Since the passage of the Vocational Education Act of 1963, a signifi- 
cant amount of money has been available for vocational education research. 
During this time, many important research programs and projects have been 
undertaken. Unfortunately, during this period of years, there have also 
been a number of false starts, changes in direction, and budget problems. 
Goals and priorities have changed in the U.S, Office of Education as new 
personnel occupied decision-making positions and new administrations have 
taken office. Late passage of budgets and variations in the amounts 
appropriated for research from year to year have raised additional problems 
for researchers. In addition, vocational education has lacked a large 
cadre of experienced researchers. 

As a result of these experiences it has become apparent that there is 
a definite need for continuity and stability in the vocational education 
research environment. Also, the need for larger scale research efforts has 
become more apparent. The individual researcher working on a problem 
limited to his resources and those of his local administrative ur.it usually 
does not arrive at the solutions needed for contemporary problems. Moreover 
the various topics pursued by individual investigators are typically 
unrelated. Thus, although a project may be successfully completed, the 
findings often have few applications beyond the boundaries of the education- 
al institution in which the problem was studied. 

. An effective research program requires continuity and additivity. 
Research goals and priorities must have sufficient clarity and stability to 
stimulate valid research efforts and insure that projects are completed, 
replicated, and utilized as building blocks in larger scale research efforts 
Successive research studies must build upon the successes and failures of 
prior studies, and the results of projects in progress at the same time 
should complement and supplement each other as well as being directed at 
critical problems, A well planned, coordinated program of vocational 
education research would be considerably more productive than present 
planning systems. 

Another aspect of the research system which needs attention is the 
degree to which available research competencies are effectively utilized. 

The Vocational and Technical Education System in Wisconsin has a number 
of competent researchers with an intimate knowledge of the problems faced 
by vocational educators. Another source of researchers is the faculty of 
the University of Wisconsin System. For example, within the faculty at 
the University of Wisconsin - Stout resides one of the largest groups of 
professors found in any university in the United States which is dedicated 
to the training of vocational and technical education personnel. It woiTu*. 
appear that vocational education in Wisconsin has a number of professional 
personnel who could serve as senior researchers. 

Another source of potential researchers is the graduate students 
enrolled in programs leading to degrees related to vocational education. 
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These students provide two valuable resources. First, each usually has to 
complete a research activity of some type ir order to attain his advanced 
degree, I). the past, graduate research theses, Plan B papers and 
dissertations have had varied impacts depending upon the topics investigated. 
Moreover, each of the studies has tended to have slight, if any, relation- 
ship to other graduate research carried out. As a result, these studies, 
even if done skillfully, usually do not have significant impact on the 
problems faced by vocational education or education in general. Fre- 
quently this lack of impact is a source of discouragement to a graduate 
student researcher and causes him to question the value of research. Sec- 
ond, graduate students are potential staff members in vocational and 
technical education programs in Wisconsin, Development of valid research 
skills in graduate programs and relevant research experiences which lec*d 
to an increased interest in research will help to increase the number of 
vocal ional personnel who are capable and interested in doing research, 

A large number of vocational education research projects are under-* 
taken in Wisconsin each year. It would appear that these research efforts 
could be more productive and efficient if they could be integrated in a 
master research plan. In addition, the availability of such a plan would 
aid in programming graduate research efforts, thus resulting in more 
effective research training in graduate student programs. As a Vesult, . > 
increased resource of personnel competent to become involved in the research 
process would be available to vocational education in Wisconsin. The 
Convergence Planning Technique developed for large scale medical research 
programs provides a planning technique which could resolve these needs. 



Problem 



This study was concerned with determining if the Convergence Planning 
Technique could be applied to vocational education in Wisconsin 

to obtain a valid research plan. 



Objectives 



The following objectives guided this study: 

1. ; - ! :nt if y the major problems faced by vocational education in 
Wisconsin. 

/ 

2. Determine the overall goal(s) for a convergence plan for vocal ional 
research in Wisconsin. 

3. Identify the relationships between the overall goal, the problems 
and the magnitude of the research problems identified. 

4. Construct the Convergence Research Plan, 
a. Identify the research logic. 
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b. Identify the research flows. 

(1) Specify the linear research array including the phases, 
steps and projects within it. 

(2) Outline the concurrent research array. 

(3) Outline the supplementary research array. 

c. Identify the information flow in the convergence plan, 
especially the communications between the institutions 
involved in the plan. 

d. Identify resources needed to implement the plan. 

e. Establish suggested research priorities on the basis of the 
plan . 

5. Determine the possibility of implementing the convergence plan. 

6. Identify how various institutions can utilize the Convergence 
Research Plan. 



Framework for the Study 

A variety of network planning techniques have been developed to aid 
in identifying the activities and sequences of activities required to com- 
plete a product or project. Critical path analysis and PERT are two 
examples of more than a score of similar techniques developed in industrv. 
These techniques have proved to be very useful in industry for identifying 
the logical relationships among the activities and the critical sequence of 
events. Network analysis and planning have also been widely applied in 
educational research; however, they have not proved to be as .useful in 
this field as in industry. Network analysis techniques require well- 
defined activities that can be placed in a logical sequence and carried to 
completion if sufficient effort is expended. Research frequently involves 
many unknown or partially defined variables and thus is not totally 
amenable to network analysis and planning. (This is not meant to infer 
that network analysis techniques have no applications in research projects. 
They may be very useful in planning the activities required to complete a 
specific portion of a larger research project.) 

The Convergence Technique was designed to provide a more flexible 
planning system for research. It was first used in medical research but 
it has since been applied to education research (Carrese and Baker, 1967; 
Gephart, 1970). Three general criteria were utilized in developing the 
Convergence Technique: (1) a logic inherent to the substitive area to b<- 

studied must be the basis for planning the general research program, the 
sub-programs and the specific research activities encompassed in it; 

(2) since every event in research cannot be known beforehand, allowances 
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for this tentativeness are necessary; and (3) time specifications for re- 
search activities must take into account the fact that research achievements 
often cannot be scheduled to specific deadlines, thus there is need for 
flexibility and continuous review of the progress of various research 
activities rather than immutable deadlines. The Convergence Technique is 
a process for identifying the components of a major research program and 
ordering them in a series of planning units which move from general to 
very specific. The result is a matrix which represents in graphic form a 
coordinated series of research projects and programs which are also 
identified with the information and resource requirements needed to 
initiate and carry them out. 

Figure 1 presents an example of the convergence matrix in outline 
form. The matrix has been partially completed to illustrate each of the 
components of the plan and to define the linear research array. This 
matrix was developed to illustrate the Convergence Technique and was not 
intended to be utilized for research planning without further development. 
(The research matrix developed in this project is given in Chapter 3.) 
Figure 1 depicts the three major flows of coordinated activities in a 
convergence plan: (I) research, (II) information, and (III) resources. Tn 

this example the goal was the use of functional tests to assess teaching 
competencies. The data needed to assess the progress of individual pro- 
jects to determine the overlaps and gaps in research activities, and 
manage the overall research program are provided by the information 
flow (II) . The resource flow (III) identifies the personnel, materials, 
equipment and facilities, and costs associated with each step. When these 
resources cannot be provided in the total research program modifications 
have to be made in the research flow. In other words, research activities 
have to be scheduled on the basis of resources available. 

Within the research flow are three separate sub-flows of research 
activities: (1) linear array, (2) concurrent array, and (3) supplementary 
array. The linear array defines the main research efforts which are 
critical to achieving the goal or goals of the total research program. In 
the example given in Figure 1, the linear array contains the objectives 
for applied research projects essential to the development and utilization 
of the competency tests. The linear array is further sub-divided in 
hierarchical order into phases, steps, and projects. Fach phase defines a 
broad area of research related to the overall program goals. The order of 
the phases provides a logical sequence of activities and is based upon the 
general research logic involved in test development. Within each phase 
more specific areas of research are defined and identified as steps. Note, 
for example, in phase one in Figure 1 the first step is based on concep- 
tualizing the role of the teacher. Further definition of research 
activities takes place through the identification of research projects 
within each step. For instance, several research projects would probably 
be developed to identify the role of the teacher. Projects investigating 
the role of the teacher in a differentiated staffing plan, in mediated 
instruction, individualized instruction, and more traditional instructional 
systems could be initiated. 
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Since several projects are typically undertaken to attain the ob- 
jective established for a specific step, the convergence, plan provides a 
variety of opportunities for individual researchers to undertake projects. 
Moreover, in many instances there will be the need to replicate studies 
under varying conditions, thus a number of districts and schools can be- 
come involved in the research projects associated with a given step in the 
convergence plan. The Convergence Technique not only allows for a widc- 
scale participation in research but it provides a basis for coordinating 
the activities for researchers studying the same or similar problems in 
several institutions. For example, within the first step in Figure 1, 
research might be carried out in vocational-technical schools, secondary 
school systems, CESA*s, state-level agencies, and universities. A con- 
vergence plan would provide an opportunity to exchange ideas and informa- 
tion and pool the efforts of these researchers. 

A basic concept in the Convergence Technique is to focus research 
activities on the end goal or goals of a specific research program. The 
process of developing a convergence plan, however, moves from these general 
goals to somewhat more homogeneous groupings of research activities, which 
are entitled phases, into steps which are even more specifically defined 
areas of research activity. In order to attain the goals set for each 
step, specific research projects are undertaken. In summary, the process 
is one of differentiating the research activities required to attain the* 
goals of a research program into more specific objectives through the use 
of phases, steps and projects which are logically sequenced and hierarchi- 
cally ordered on the basis of research logic associated with the discipline 
investigated. By using this process the researcher is able to logically 
define and plan specific research projects which are related to larger 
program goals. The use of phases, steps and projects organizes the 
information in the research plan in a manner which does not exceed the in- 
formation processing capabilities of the human mind. [George Miller has 
suggested that man's immediate memory span and ability to make comparative 
judgments is limited to 7+2 dimensions or catagories (1956)]. Application 
of the Convergence Technique provides relatively few phases to be inter- 
related and compared. Within the phases the researcher can interrelate the 
steps. And finally, within a step a set of projects undertaken to attain 
a common goal can be more easily correlated than in a situation where 
several hundred research projects might be on-going and somewhat loosely 
related to the overall goal established for the convergence plan. In 
other words, research carried out in vocational education has been 
concerned with improving the quality and delivery of vocational education 
to the citizens of Wisconsin. However, the task of interrelating these 
various projects is extremely difficult without some method for organizing 
them in related research areas. 

Research activities and projects that are not considered critical 
the achievement of the goals of the total research program arc Listed in 
the concurrent and supplementary array s . However, if tine and resources 
permit, successful completion of these projects will produce valuable in- 
puts for the linear array. Since the linear array is basic to the re- 
search program, its sequence and structure (logic) directs the sequence oi 
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nativities in the concurrent array. Projects in the supplementary nrr.iy 
entail longer-term and higher-risk activities tlian those in the concurrent 
array which are more directly correlated with projects in the linear array. 
The objectives listed in the concurrent and linear arrays and Figure 1 
reflect these conditions* 

When a convergence plan is designed no consideration is given to 
existing research findings or projects underway. After the plan lias been 
logically structured, existing research studies are identified and noted on 
the plan. It is very possible that a step or phase may require little if 
any additional research. In other words, the goals of the step can be 
accomplished by utilizing the results of prior studies. For example, the 
work of Spanbaucr (1972) at Fox Valley Technical Institute might provide all 
or part of the task analysis data needed for step two in phase 1 of the 
convergence plan given in Figure 1. 

After the research arrays have been developed, the information flow 
can be designed. The function of the information flow is to provide in- 
formation for the management of the overall research program, major 
decisions that must be made in relation to the progress of research 
activities, and interchange of ideas betv’een researchers working on related 
projects. The information generated will also provide the basis for 
communiques concerned with the progress of research and research results 
which can be distributed to vocational educators. 

The last major flow in the convergence plan is termed "resources". 

This flow is developed after the research and information flows have been 
identified. As noted in Figure 1 this flow identifies the personnel, 
facilities and equipment, materials, and money required to accomplish the 
objectives established in the linear array. The resources flow is divided 
into the same steps as the linear array. Detailed development of this flow 
will be dependent upon complete identification of the projects to be 
carried out in each step and phase of the convergence plan. Thus, it may 
not be possible to completely identify all of the elements of this flow 
when the convergence plan is first developed. The attempt to define this 
flow, however, should identify potential areas of need in terms of personnel 
and other resources. 

Although the Convergence Technique structures an integrated research 
program, there is still considerable opportunity for the individual re- 
searcher and groups of researchers to select and initiate projects of 
interest to them. The projects within the steps allow flexibility of 
approach and the concurrent and supplementary arrays provide even greater 
latitude for the selection of a research problem and research methodology. 

Convergence planning is heuristic in that it suggests areas to study 
and provides tin* general framework for these studies. Also the conver- 
gence plan permits the researcher to see the relevance of his research. \y 
is envisioned that these two characteristics of the Convergence Technique 
will encourage graduate students to investigate valid and critical problems. 
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cause their research activities to be more relevant, and bring the sum 
total of their research activit Los to hear on large and significant pro- 
blems in vocational education. Similar effects should he noted in the 
VTAK system as individual researchers arc able to identify the relationship 
of their project to other ongoing research projects in the system and 
vocational education.. 

Vocational educators can use the convergence plan to assist in defining 
their research problems, aid in identifying related research and help in 
planning their studies. University staff members may want to investigate 
specific problems identified in the convergence plan. lr. addition, they 
will be called upon to review, summarize and integrate the research findings 
of graduate students. Also, they will probably be the prime authors of the 
theoretical research required in the plan. Another area in which they may 
wish to become involved is in the research identified in the concurrent 
and supplementary arrays. 



Chapter 2 

PROCEDURES USED IN DEVELOPING THE RESEARCH MATRIX 



Introduction 

Two committees, Director's Research Committee and Steering Committee, 
provided suggestions for the general conduct of this study. These committees 
also reviewed the results of the Research Problems Survey and the Steering 
Committee reviewed the Research tetrix. The Matrix Committee helped develop 
the Research Matrix. Ensuing pages describe the work of these committees 
and the development of the problems survey. 



] Committees 

i 

Director's Research Committee 

The Director's Research Committee was asked to react to the objectives 
and activities identified in the Convergence Research Project Proposal in 
October, 1971. Committee members made several suggestions stressing the 
j need for the involvement of VTAE district personnel in identifying the 

1 problems and noting the importance of having the Research Coordinating Unit 

(RCU) manage the Convergence Research Plan which would result from the 
•- study. Several questions were raised in regard to the interface between a 

I Convergence Plan that might be developed and local research activities. It 

was emphasized that the Convergence Technique would appear to provide a 
framework within which individual projects could be carried out at the 
j district level much the same as in the past. The value of the Research Matri 

- would be the ability to correlate and plan related studies in order to attack 
larger problems and provide a basis for greater generalization of research 

]* results. At the close of the discussion, the committee asked that it be kept 

\ informed of progress of the study and be involved when appropriate. 

•- Late in March, 1972, the director of the Convergence Project met with 

j a sub-committee of the Director's Research Committee to assist in the process 

of identifying research priorities to be recommended to the VTAE Director’s 
Committee. At this meeting, a summary of the responses from the VTAE system 
was used in the determination of the most critical problems faced by the VTA'- 
•i system in Wisconsin. A computer analysis of the magnitude of each problem 

included in the survey form was made available for the sub-committee members. 
] The print-out also contained a summary of the research priorities identified 

j by the responders. (A copy of the research instrument is reproduced in 

Appendix C and the summaries of the information collected are given in 
Appendix D.) On the basis of the results of the survey, research priorities 
j were established and distributed for review by the complete committee. In 

— April, the Director's Research Committee reviewed and discussed the report 
of the sub-committee. With the exception of some editorial changes, the 

]' recommendations for research priorities were approved by the research commit - 

i tee. Later the Director's Committee approved the priorities recommended by 
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the Director’s Research Committee. These priorities were used by the 
Wisconsin Board for Vocational , Technical and Adult Education during the 
1972-73 year. 

A Steering Committee was established to assist the project in iden- 
tifying research problems and priorities, developing the instrumentation, 
constructing the research design, and reviewing the find research matrix. 
Members of the committee were identified by Mr. Roland Krogstad, Research 
Consultant WBVTAE, and the Director of the Convergence Research Project. 

(A list of the committee members is given in Appendix A.) Members of the 
committee represented agencies concerned with one or more aspects of voca- 
tional education. 

The first meeting of the Steering Committee was held on October 29, 

1971, in the WBVTAE Office Conference Room. This meeting opened with a 
review of the project proposal. Next, the convergence technique was 
described and discussed. After the convergence technique had been explained, 
the buzz session technique was utilized to identify research problems rolaLcd 
to vocational education. More than 50 problems were identified during this: 
session. 

The last part of the meeting was devoted to specifying the relationships 
between the research problems identified. Tentative research phases were 
established for the problems to further illustrate the Convergence Technique. 

At the conclusion of the meeting, the participants indicated a willingness 
to continue serving on the Steering Committee and assisting the project 
through the identification of problems and resources. 

The second meeting of the Steering Committee was held on May 23, 1972. 

At this meeting, the research matrix developed by the Matrix Committee was 
reviewed and criticized. (A copy of the agenda for the May 23 meeting is 
reproduced in Appendix E.) Several modifications in the research logic 
diagram and research matrix were suggested by the Steering Committee. The 
research logic diagram and research matrix which appear in this report 
include the modifications suggested by the Steering Committee. The members 
of the Steering Committee also made a number of valuable suggestions related 
to disseminating the results of this project and utilising them in ongoing 
research programs. These suggestions will be discussed in more detail in 
the next chapter. At the conclusions of the meeting, the members agreed 
that they would like to remain on the Steering Committee and meet again during 
the next year . 

Matrix Generation Committee 

Members of the Matrix Committee were selected to represent VTAE schools. 
Research Coordinating Unit (RCU) , Department of Public Instruction, LVEC’s 
and the university system. (The members of this committee are listed in 
Appendix B.) This committee met on the campus of the University of Wisconsin - 
Stout on April 18, 19, and 20, 1972. After a review of the Convergence 
Technique, the committee members were introduced to the results of the 
Research Probl^ns Survey • The remainder of the first morning was spent 
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these results. In the afternoon the committee, with the help of 
a, Systems Analyst Specialist from the Department of Industrial 
a I, Stou t> developed a research logic diagram for vocational 
The initial step in developing this logic diagram was identifi- 
the overall goal for the Convergence Research Plan. The goal 
was to improve the quality of vocational, technical and adult 
programs to better meet the needs of citizens of Wisconsin. 



After the research logic had been established, members of the committee 
urne t eir attention to development of the linear research array in the 
Convergence Matrix. Most of the remaining two days were devoted to this 
task. Each committee member picked a subsystem from the. research logic 
system and analyzed it into phases, steps, and projects. As projects were 
identified, they were noted on 4" x 6" cards and placed in appropriate 
equence on a large convergence chart mounted on the walls of the conference 
room. After all of the phases and steps had been identified, the relation- 
ships between them were studied. The sequence of research activities was 

“ 8t f„ °" the basis ° f this review - After the meeting had adjourned cm 
P * e P ro J ec t director spent approximately one week synthesizing 

ie work of the committee members. The results of the efforts of the 

committee and the synthesis is presented in the research matrix reproduced 
in tnapter 3. 

H 1 -c„! ef a r !w C °" C c Udin8 tHe matrix material, the members of the committee 

given' to \£p e fl °T t T and . resources ^ows. Much of the discussion was 
h l ° f lnfor mation related to research problems and projects. 
T nberS concurre d that the RCU should be the central agency dissem- 
. ln ^ orma p lon of research on problems related to vocational education 

si? — * Ib Wa ? ? oted that the responses to the Research Problems 
Survey will provide information on individuals concerned with specific 

resource ! 'T ^ wil1 help in communications and will also identify 
resource people for various projects. Committee members felt that final 
determination of the resources flow will have to be based upon specific 

projects proposed within steps in the research matrix, and that they should 
not attempt to do this. 



Identification of Research Problems 

for J?* Di !? Ct °f ° f tbe Conver gence Project met with the assistant director, 
for instructional services and the assistant directors for research and 
p anning in the VTAE districts in Wisconsin. At each meeting, the VTAE 

wire n faced t0r ?h Were t0 identify the ma J or Problems with which they 

were faced. These meetings were conducted during November and December, 

1971, and January and February, 1972. Approximately one-half day was spent 
at each of the vocational-technical schools. P 



During the course of the project, the 
Center for Vocational, Technical and Adult 
were contacted through the Center. During 
had an opportunity to identify a number of 



director also worked with the 
Education. A number of LVEC's 
these meetings, the researcher 
problems of concern to the LVI-C 
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During the initial phase of the project, it had been planned that the director 
would meet with the LVEC's during their winter meeting in Wisconsin Dei Is. 
However, this meeting had to be cancelled by DPI because of n conflict. 

During the time the project director was meeting with VTAE personnel 
and LVEC * s the project research assistant was reviewing RCU quarterly reports, 
WBVTAE problems lists, research reports, and journal articles to derive addi- 
tional research problems. Each problem encountered was placed on a tab card. 
The project research assistant also processed the results of" the interviews 
conducted by the project director and placed the problems identified on tab 
cards. Approximately two thousand problem statements were accumulated through 
this process. 



Development of the Survey Instrument 

The problem statements generated through the review of literature and 
meetings with vocational educators were used to develop the survey instrument. 
The cards were first sorted into piles of identical problem statements. For 
example, a number of identical problem statements were recorded for the need 
to obtain valid job market data. All of these statements were replaced in 
one pile or category. After all of the identical statements had been iden- 
tified, the problems were reviewed to determine more homogeneous problem 
areas encompassing sub-set.s of several similar problems. As a result of 
this process, sixteen problem areas were established. 

Problem statements were developed for the sixteen problem areas. Next 
a representative sample of specific research problems was selected for each 
of the problem areas. In order to keep the instrument tc a practical length, 
an attempt was made to present as few statements as possitle for each problem 
area and still maintain a representative sample. Approximately five blank 
spaces were provided in each problem area so the responder could identify 
additional problems of concern to him. This allowed the researcher to jdon- 
tify problems which had not been included in the original list and guarded 
against the omission of one or more critical problems during the process of 
developing the survey instrument. 

Two response continuums were established for each item in the survey 
instrument. On the first, the responder was asked to identify the magnitude 
of the problem in his district, school or unit. Values on this scale ranged 
from 1, Problem Does Not Occur", to 7, "Very Critical Problem". Very critimj 
problems were defined as those which had significant impact on meeting the 
objectives of the vocational programs in the responder's district or school, 

The instructions directed the responder to use a rating of "7" for the four 
or five most critical problems in his educational agency. Responders wer ? 
also asked to identify when research was needed on these problems. Three 
response categories were provided. Responses were (] ) within one year, 

(2) between one to five years, and (3) six years and over. (A copy of the 
survey instrument lias been reproduced in Appendix C.) These two response 
continuums were used to identify the magnitude arid the suggested prior itv 
for research for each problem. No doubt there is considerable overlap 
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between these tvo sets of responses; however, the magnitude readings 
provide a basis for including the problem area in the Convergence Matrix 
and the priority ratings suggest when research should be initiated. 

The original draft copy of the survey instrument was piloted with 
instructional services, research and planning, Steering Committee, and 
WBVTAE staff members. As a result of their comments, the original response 
continuum for magnitude was increased from 5 to 7. Since the problems had 
already been screened and had importance to vocational education, a continuum 
of 5 was not large enough. Very few responses were received below a moderate 
level (3) of importance. Thus, with a scale of 5 the responder could only 
choose from 3, A, and 5 in most instances. Increasing the scale to 7 added 
another response position beyond "moderate. 11 Responses on the final survey 
indicated the 1 to 7 scale worked effectively. After piloting the instrument, 
revisions were made and the instrument was reproduced. 



Populations Surveyed 

Several groups involved with vocational education in Wisconsin were 
included in the problems survey for the Convergence Project. An attempt 
was made to include vocational educators with special knowledge and 
acquaintance with the problems of vocational education. 

The following groups were included in the survey: 



VTAE System 

1.1 Directors of each of the vocational-technical districts 

1.2 Assistant directors for instructional services in VTAE 
districts 

1.3 Assistant directors for research and planning in VTAE 
districts 

l.A Assistant directors for student services in VTAE district; 

1.5 Members of WBVTAE staff 

Secondary System 

1.1 All local vocational education coordinators 

1.2 Members of the Career and Manpower Development Department 
at DPI 



3. Steering Committee 



v 
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Chapter 3 



DEVELOPING THE CONVERGENCE RESEARCH PLAN 



Survey Results 



As noted in the previous chapter, the research problems survey instru- 
ment was developed on the basis of interviews conducted with vocational 
educators and a review of literature concerned with problems in vocational 
education. The first draft of the instrument was piloted and revised 
before being reproduced in final form. The survey was mailed in February, 
1972. Responses to the initial mailing were excellent. A follow-up 
letter was mailed to non-responders approximately two weeks after the 
initial mailing. 

Response Rates 

Table 1 presents the response rates for each of the populations 
surveyed. More than 80 percent of the survey forms mailed to the VTAE 
System were completed and returned. The directors' returns are lower than 
the other populations surveyed within the VTAE System. However, several 
of the directors noted that they were asking their research and planning 
administrator to complete the survey form for them. Thus, the percentage 
of response for the directors underestimates their input to the survey. 

Returns from the secondary system ran slightly lower. However, the 
LVEC group is considerably larger than any of the other populations 
surveyed, and the project did not have the number of direct contacts with 
them it had with the VTAE personnel. Thus, the 68 percent response rate 
reflects a good response rate from this population. 

Since the summaries of responses to the survey were done in May, 
the project has received some additional returns. (See Appendix D for 
the summaries.) The one instructional services administrator who had 
not returned a form as of the time of the summary, returned his form. 

One additional student services person has also completed and returned 
his form. In addition, five more LVF.C's returned their form. Because 
of the time required to reprocess the summary tables on the computer and 
the fact that one or two returns would have slight effect on the summary 
statistics, the decision was made not to rerun the summaries. These 
returns will be keypunched and placed with the rest of the cards for use 
in the information retrieval system. 

Validity 

Information collected on the survey form appeared to be valid. A 
concerted attempt was made in the process of collecting ard stating the 
problems to make the form content valid. Data collected through dis- 
cussions with VTAE administrators indicated that three basic problem 
areas of concern were (1) determining the need for vocational - technical 
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Table 1 



Response Rates to Vocational Research Problems Survey 



Population 


N 


Percent Return 


VTAE System 


Directors 


17 


59 


Instructional Services 


17 


94 


Research & Planning 


17 


100 


Student Services 


17 


82 


WBVTAE Staff 


15 


80 


Secondary System 


LVEC ' s 


154 


68 


DPI Staff 


10 


60 


Steering Committee 


13 


62 



programs, (2) developing programs for students with special needs, and 
(3) program evaluation. Responses on the survey instrument revealed 
the same areas of emphasis. 

Another check on the validity of the data collected was through 
its use in determining the priorities established for research in the 
VTAE System during the 1972-73 year. A sub-committee of the Director’s 
Research Committee reviewed the summary of responses from the VTAE System 
and on this basis suggested a list of research priorities for the coming 
year. This list was passed with some editorial changes by the Director's 
Research Committee and was later approved by the Director's Committee. 
From evidence collected by the project it would appear that the problems 
included in the survey instrument were valid. 

Reliability 

The length of the survey has caused some concern for the reliability 
of the responses to the instrument. A review of the medians for each of 
the problems in the survey instrument revealed no response pattern which 
would indicate that the responders were not reacting to each of the 
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problem statements. In other words, there was no consistent decline or 
increase in the medians in the middle and latter part of the instrument. 

In fact, the response patterns varied throughout the survey instrument and 
the problems identified as having the largest magnitude came from various 
segments of the instrument. 

Another check on the reliability of the responses is the correlation 
between items concerned with problems in the same or similar areas. It 
would be expected that the correlations between these items would be 
positive and statistically significant. Table 2 presents the correlations 
for the responses of the research and planning administrators to selected 
items in the research problems survey instrument. All of the correlations 
are positive and statistically significant, thus suggesting a consistent 
pattern of response to the items. 



Table 2 



Correlations between Selected Items for the Responses 
of VTAE Research and Planning Administrators 







Content of Items 






Items 


Correlated 


First 


Second 


r 


i 


12 


Need for V-T programs 


Ident. appropriate programs 
for school 


.72 


i 


1A 


Need for V-T programs 


Determining feasibility of 
a program 


.87 


13 


20 


Selecting relevant 
content 


Providing relevant general 
education 


.67 


58 


87 


Assessing relationship 
of student charact. to 
success in occupation- 
al programs 


Developing programs that 
meet the need of the 
handicapped 


.76 


58 


162 


Assessing relationship 
of student charact. to 
success in occupation- 
al programs 


Developing a bank of 
information for planning 
decision-making 


.76 




Major Problem 


Areas and Problems 







Kach recipient of a survey instrument was asked to rate the problem 
area and problems based on his assessment of the magnitude of the problems 
in his district, school or unit. Responses to the survey were summarized by 
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population. Medians and interquartile ranges were computed for the 
responses by each population on each item on the survey. The median re- 
flects the typical level of response to a given problem. The inter- 
quartile range provides an indicator of the level of agreement in each set 
of responses. (The inter-quar tile range indicates the number of score 
intervals required to band the center 50 percent of the responses.) The 
medians can be used in two ways in analyzing the survey responses. First, 
they can be compared to the scale values used in the survey instrument. 

For example, a median of 6.5 on the magnitude rating would indicate that 
one-half of the responders had checked ,, 7" (very critical). Second , medians for 
the several groups surveyed can be contrasted to determine the relative 
magnitude of a problem as perceived by each group. A complete summary of 
the medians and inter-quartile ranges for the groups surveyed is presented 
in Appendix D. 

Ranking of Problem Areas 

The median rating given each problem area by each of the groups 
surveyed is given in Table 3. The rank order of the medians in each group 
is also given. A review of the data in Table 3 indicates considerable 
variability in the ratings given each of the problem areas by the seven 
populations involved in the research problems survey. Illustrative of 
this variability is the range of ranks found for problem area 1, which it; 
concerned with determining the need for vocational - technical programs. 

In problem area 1 the rank of the medians ranged from "l", largest mag- 
nitude, to "16", smallest magnitude. The average rank was 7.9. 

A review of the responsibilities of the individuals in each of the 
populations reveals a high correlation between the responsibility of the 
responder and the problem areas rated as being of high magnitude. In 
other words, the responder gave the highest ratings to those problems 
associated with his function. As a result, averages or average ranks of 
problem areas are not too meaningful in making decisions on the magnitude 
of problems in vocational education in Wisconsin. Rather, one must look at 
the composite picture presented in the ranks for each population surveyed. 

This mosaic more accurately represents the magnitude and scope of vocational 
education research problems in Wisconsin. 

Four separate problem areas: (1) determining the need for vocationai- 

technical programs; (2) program and curriculum development; (3) evaluating 
programs for students and staff; and (4) maintaining an effective public 
relations program - received a rank of "1", or in other words, were identified 
as the most critical problem area by one of the groups in the survey. In 
addition, the VTAE instructional services administrators had four areas 
which attained the same high median rating (5.50). These problem areas 
included creating effective administrative procedures and structures; 
identifying and allocating resources; planning, obtaining and utilizing 
facilities and equipment; and making valid decisions and plans. The 
disparity in the ranking of problem areas suggests that decisions made 
related to a research program will have to be based upon the needs of each 
specific group surveyed instead of being based on the average ranks or a 
composite summary of the data. 
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Table 3 

Rank Order of Problem Areas for Each Population Surveyed 
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Major Problems 



After the summaries of the responses had been run, a frequency chart 
was developed to display the frequency of occurance of medians of various 
magnitudes found in the survey. This table is reproduced in Appendix D. 

The information in this chart was used in identifying the major problems 
identified by each population in the study. Table A presents the major 
problems and their median rating for each population in the study. Again, 
the influence and perspective supplied by the responsibilities and tasks 
encompassed in the job of the responder are in evidence. Directors of 
VTAE schools, for example, placed the most emphasis or. problems concerned 
with decision-making, identification and development of new programs, and 
the evaluation of staff. Although there were some common problems, the 
VTAE instructional services administrators gave more emphasis to defining 
the role of the teacher in new instructional settings, providing approp- 
riate learning activities and materials, and developing learning activities 
that are effective with disadvantaged students. 

i 

Research and planning administrators in the VTAE system were more 
concerned with the problems associated with determining the occupational 
training needs of the people in their districts; identifying the costs, 
benefits, and effectiveness of their programs; and determining the manpower 
needs for their area and region. Student services administrators in the 
VTAE system received an abbreviated form containing those items related to 
their function. Career education, career decision-making procedures, and 
learning activities that are effective with the disadvantaged received the 
highest ratings. Staff members at the Wisconsin Board of Vocational, 
Technical and Adult Education placed most emphasis on problems concerned with, 
providing appropriate in-service experiences for VTAE staff members, 
initiating services and programs for the disadvantaged, and developing a 
better image of vocational - technical education. 

Local vocational education coordinators (LVEC's) placed greatest 
emphasis on the problems concerned with career education and career decision- 
making. Similar problems were rated high by the staff of the Career and 
Manpower Development staff in DPI. In addition, the DPI staff members indica 
ted that obtaining valid job market data, planning facilities, and artic- 
ulating programs with post— high school institutions were also major problems. 
Members of the Steering Committee rated selecting and training students co 
work with the disadvantaged as the most critical problem. Developing a 
better image of vocational education was also given high emphasis. Other 
problems of importance were concerned with designing ah ongoing public 
relations program, obtaining valid job market data, and designing an 
articulated K through adult career education program. 

Some common problems are found among the major problems identified by 
each group. However, there are also a number of unique problems in each 
group. This phenomenon was observed throughout the survey instrument. 

Table 5 presents the correlation coefficients for each contrast for the 
relationships between the median ratings assigned to the problems and 
problem areas by each population. If two groups assigned the same mag- 
nitude to each problem in the survey or the rank order of the magnitudes 
W6re the same, the correlation coefficient would be 1. The correlation 
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Table 4 



Major Problems Identified by Each Population Purveyed* 



Population (Problem) 



Median 

Magnitude 



i 



I 

I 

j 

l 

[ 




VTAE Directors 



Using research data in decision-making 6.50 

Working with accrediting agencies and associations 

in the development and approval of new programs 6.25 

Designing and using valid staff evaluation procedures 6.16 

Utilizing evaluation data in decision-making 6.00 

Obtaining research data needed in decision-making 6.00 

Planning facilities that facilitate learning 6.00 

Selecting the information and techniques needed in 

deci s ion-making 6 . 00 

VTAE Instructional Services Administrators 

Defining the role of paraprof essionals 6.21 

Specifying the role of the teacher in new instructional 

systems 5.92 

Determining the costs, benefits and effectiveness of our 

proposed programs 5.90 

Planning facilities that facilitate learning 5.83 

Providing learning activities and materials that are 

appropriate for the learning style of the individual 5.83 
Developing learning activities that are effective with 

the disadvantaged 3.83 



VTAE Research and Planning Administrators 



Determining the occupational training needs of the 

people in our district 6.20 

Determining the costs, benefits and effectiveness of 

our present programs 6.00 

Obtaining valid job market data 5.85 

Developing long-range plans 5.83 

Forecasting manpower requirements for our area and 

region 5.71 



VTAE Student Services Administrators 

Identifying career decision-making procedures that lead 

to valid career selection 6.20 

Relating career education concepts to the developmental 

stages of students 6.08 

^Approximately the five problems with the largest medians. In cases 
of ties, there will be more than five. 
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Table A continued - Major Problems Identified by Each Population Surveyed 



Population (Problem) 



Median 

Magnitude 



Developing learning activities that are effective 

with the disadvantaged 6.08 

Integrating career development concepts with present • 

courses and programs 6.00 

WBVTAE Staff 



Providing appropriate in-service experiences for our 

administrative staff 6.83 

Initiating services that assist the disadvantaged in 

successfully completing occupational programs 6.75 

Selecting and/or training staff to work with the 

disadvantaged 6,75 

Determining the competencies our staff members need 

to develop 6.75 

Developing a better image of vocational - technical 

education 6.71 



LVEC's 

Designing an articulated K through adult career education 



program 6.50 

Integrating career development concepts with present 

courses and programs 6.29 

Designing more effective vocational counseling programs 6.28 

Identifying career decision-making procedures that lead 

to valid career selections 6.19 

Relating career education concepts to the developmental 

stages of students 5.96 

Developing a more effective placement program 5.81 



DPI Career and Manpower Development Staff 

Designing an articulated K through adult career education 



program 6.75 

Obtaining valid job market data 6.75 

Identifying career decision-making procedures that lead 

to valid career selections 6.75 

Planning facilities that facilitate learning 6.75 

Articulating our programs with those in which our 
students enroll after completing our programs 
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Table A continued - Major Problems Identified by Each Population Surveyed 



Population (Problem) 



Med ian 
Magnitude 



Steering Committee 



Selecting and/or training staff to work with the 

disadvantaged 6.50 

Developing a better image of vocational - technical 

education 6.16 

Designing an ongoing public relations program 6.00 

Obtaining valid job market data 6.00 

Designing an articulated K through adult career 

education program 6.00 
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Correlations .20 and larger are significant at the .05 level. 



coefficients in the table indicate slight to moderate levels of agreement 
in the ratings assigned to each problem and problem area. As noted at the 
bottom of the table, any correlation of .20 or larger is statistically 
significant at the .05 level. In other words the relationship displayed 
by the correlation coefficient would occur 5 percent or less of the time 
by chance. 

It is interesting to note that the highest correlations tend to be 
between groups within the same svseem. For example, the directors* 
responses correlate more highly with those of the instructional services 
administrators, research and planning administrators and WBVTAE staff than 
they do with those of the LVECs and DPI staff. Similarly the LVECs* 
responses correlate more highly with the responses from the DPI staff 
members. These results suggest that each system faces some unique problems. 



1972-73 Research Priorities for the VTAE System 



Responses on the research problems survey instrument from the VTAE 
System were used in establishing recommended research priorities for the 
VTAE System. The director of the Convergence Research Project met with a 
sub-committee of the Director* s Research Committee in La Crosse, Wisconsin 
at the end of March, 1972, to review the summaries of responses from the 
survey. Five summaries were presented to the sub-committee: (1) directors; 

(2) instructional services administrators; (3) research and planning admin- 
istrators; (A) WBVTAE staff members and (5) composite summary encompassing 
the members of the four groups. 

After reviewing the summaries of the survey responses, the sub- 
committee developed the following recommended priorities for consideration 
by the Director *s Research Committee: 

1. Determining the need for vocational - technical programs 
with an emphasis on obtaining valid job market data, 
forecasting manpower requirements and determining 
occupational training needs for people in the district. 

2. Determining the need for programs and services to meet 
the needs of disadvantaged students. 

3. Developing effective career education programs with an 
emphasis on designing an articulated K through adult career 
education program. 

A. Evaluating programs, students and staff with an emphasis 
on designing valid staff evaluation procedures and 
utilizing evaluation data and decision-making. 

5. Creating effective administrative procedures and structures. 

6. Evaluating the effectiveness of learning accivities and 
ma terials. 
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7. Special problems that received high ratings and were 

recommended for high priority were 

a. Developing flexible entry points to programs. 

b. Encouraging staff members to utilize research data. 

c. Determining costs, benefits and effectiveness of 
vocational - technical programs. 

d. Identifying the need for new facilities to local voters. 

e. Developing a more effective placement program. 

The Director's Research Committee reviewed the priorities identified 
by the sub-committee. With the exception of slight editorial changes, the 
Research Committee accepted the recommendations of the sub-committee. 

These recommendations were forwarded to the Director's Committee for their 
action. The Director's Committee approved the priorities as identified 
by the Research Committee. 




Development of a Research Matrix 



As described in Chapter 2, the research matrix was developed by a 
committee comprised of vocational educators, the project director and a 
specialist in systems analysis techniques. The starting point in 
constructing the research matrix was the identification of the research 
logic inherent to problems in vocational - technical education. The first 
step in developing research logic was the definition of the end goal for 
the research matrix. The goal identified by the committee was to "improve 
vocational, technical and adult education programs to bettec meet the 
needs of the citizens of Wisconsin". With this goal as a guide, the 
research logic system graphically depicted in Figure 2 was developed . 

Since the end goal of the research matrix focuses or. new and improved 
programs, the central sub-system in the research logic system was the 
instructional sub-system. A logical analysis was used to relate other 
sub-systems in the total research logic system to the instructional sub-system 
to enhance the development of the instructional sub-system. 

In the research logic system depicted in Figure 2, the first step in 
developing a new program or refining an existing program is to determine 
the need for the program. After this has been done, program and 
curriculum development activities can be initiated. In the process of 
program and curriculum development, there is a need to assess the needs of 
the people to be served by the program and to determine the student 
characteristics that are related to success in the program. Included in 
these two sub-steps are the research efforts required to identify the needs 
and characteristics of special student groups such as the disadvantaged 
and handicapped. 
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Research Logic System for Vocational - Technical Education 



The committee felt that the evaluation system to be used in concert 
with a program should be designed in the early stages of program develop- 
ment. Thus, the design of the evaluation system is the next element in 
the instructional sub-system. This evaluation system would he concerned 
with collecting both process and product data. 

The next element in the instructional sub-system is concerned with 
the development of effective learning activities and materials. These 
activities and materials would be designed and constructed to attain the 
objectives distilled in the program and curriculum development phase. After 
the learning activities and materials have been developed, the program is 
ready for execution. Considerations involved in implementing a program 
include the identification and procurement of the fiscal and facility 
resources required for the program. Implementation also includes conduc- 
ting the program. 

Evaluation data need to be collected as students progress through and 
complete the program. As mentioned previously, the evaluation data include 
information on students, staff and program elements. This information 
provides the basis for developing an in-service training program for staff, 
revision of the program, and validation of program development decisions. 

As noted by the element to the right of the instructional sub-system which 
links the output of the vocational education instructional sub-system to 
the society and the business and industry sub-systems, the criteria for 
judging the educational product will be concerned with the degree to which 
the products of the instructional sub-system meet the needs of society, 
business and industry. The efficiency of the instructional sub-system will 
also be of concern. 

The vocational education sub-system also includes three other sub- 
systems: (1) administration, (2) student services and (3) public relations. 

These sub-systems are connected with the instructional sub-system to show 
their ancillary role. In other words, their function is* to maximize the 
operation of instructional sub-system. 

Three additional elements are presented in the research logic system. 
These are external to the vocational education sub-system. Several local 
and state agencies concerned with the pre-service and in-service training 
of personnel for the vocational education sub-system are included in one 
element. For example, the University of Wisconsin System has a number of 
pre-service programs which develop personnel for the vocational education 
system. Thus, the UW System needs to be informed of the personnel needs 
of the system. In addition, the UW System conducts a number of educational 
experiences for the in-service training of staff. In order to make these 
experiences relevant, the university system must be aware of the needs of 
vocational educators. 

Local, state, and other agencies also provide additional services for 
the vocational educational system. An example of one of these services 
is research. The nature and progress of vocational education is critical 
to sustaining and improving society in Wisconsin. Society has two roles in 
the research logic system depicted in Figure 2. First, vocational programs 
are evaluated on the basis of the degree to which they meet the needs of 
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society. Second, a public relations sub-system is included as a vehicle; 
to provide Wisconsin citizens with information on vocational - technical 
education. 

The sub-systems, elements, aiul interrelationships depicted in the 
research logic system in Figure 2 reflect the steps and activities required 
to identify, develop and initiate effective vocational education programs. 
This system was identified on the basis of a logical analysis of the 
activities required to develop and offer vocational programs. It does not 
imply that research is needed in each of the areas, nor does it suggest 
the magnitude of research required. The data collected in the research 
problems survey provide this information. 

After the research logic system had been developed, the committee 
reviewed the results of the survey. Based on the magnitudes and priorities 
assigned to the problem areas and problems by the responders and the 
structure of the research logic system, the linear research array was 
divided into 11 subflows. Table 6 presents in the subflows in the linear 
research array. (As discussed in Chapter 1, the linear array of the 
research matrix contains the research actives considered to be essential 
to attaining the end goal of the research matrix.) 



1 

1 





Table No. 6 

Subflows in the Linear Array of the 
Research Flow in the Research Matrix 



Subflow No. 
1 

2 

3 

A 

5 

6 

7 

8 
9 

10 

11 



Content 

Design, development and implementation of programs and 
instruction 

Evaluation 

Student characteristics related to success in 
occupational programs 

Relationship between learning conditions and instructional 
materials and the acquisition of vocational skills 

Program and curriculum development procedures and models 

Decision-making models for vocational education 

Administration 

Public relations 

Dissemination 

Student services 

Professional development 
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As noted previously, each subflow was developed by a committee member and 
then integrated into the total research matrix. The process of integration 
included a review by the entire committee and a synthesis by the project 
director. 

The results of these activities are represented in Figures 3 
through 7. When reviewing the research matrix, the reader must remember 
that it is developed on the basis of the research logic inherent to the 
discipline or field and does not ;_ake into consideration, during the design 
phase of the matrix, research which has already been completed. Hence, 
there are some areas in which the reader may feel that sufficient research 
knowledge already exists. This may very well be true; however, in the 
design of the matrix, the major emphasis is on the development of a logical 
research plan. Rather than run the risk of omitting a step or sub-step 
based on the judgment of the adequacy of research in the area, it is placed 
in the matrix. After the matrix has been completed, the status of research 
in each phase and step can be determined. If there are steps in which 
sufficient research has been carried out, these can be given less emphasis 
in future research priorities. Responses to the research problems survey 
conducted with vocational educators xndicate tiie magnitude of research 
problems at the practitioner's level. A review cf research completed will 
reveal the scope and quality of data available to resolve these problems. 

If a large volume of research has been carried out in one of the steps 
identified in the research matrix, the major research activity required may 
be a synthesis of these research studies. After the synthesis has been 
completed, the major task may be one of dissemination and application to the 
problems of the practitioner. 

Because of the size of the linear array developed in this study, the 
entire matrix cannot be presented in one figure. Each of the five phases j.n 
the linear array is presented in a figure. Figure 8 presents a graphic 
outline of the phases, steps, and flows encompassed in the total research 
matrix. 



Phase I 



‘Phase I in the linear array is concerned with the analysis of needs. 
The objective for this phase is to "determine the need for vocational and 
technical education in Wisconsin, assess the present status of occupational 
education including the types of programs offered, populations served and 
problems encountered." Figure 3 presents the three steps and the subflows 
in Phase I of the linear array in the research flow. Step 1 in Phase I 
is concerned with identifying the need for vocational programs. Both socle l 
and manpower needs are included in the subflows. In addition, this step 
encompasses the design of the evaluation system to be utilized throughout, 
the research matrix and an assessment of the impact of federal, state and 
local decisions on vocational education. 

Step 2 in Phase I focuses on identification of the current output 
and status of vocational - technical programs and support services. The 
central subflow in Step 2 is concerned with the determination of present 
status, needs and outcomes of vocational education. The subflows are 
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concerned with identifying the status of programs that prepare vocational 

personnel, curriculum development procedures, student characteristics 

and learning conditions that influence the acquisition of vocational skills. 

Step 3 in Phase I focuses on the specification of the needs to be 
met by the vocational educational systems. These needs will be based upon 
the data collected in Steps 1 and 2. Information from Step 1 will iden- 
tify the programs needed in Wisconsin. Any discrepancies existing between 
the current output of vocational programs found in Step 2 and the needs 
identified in Step 1 will suggest the need for new and/or revised programs. 
Step 3 also includes research activities to identify professional develop- 
ment, student services, and public relations needs. In addition, research 
activities in the area of instructional materials and learning activities 
are also defined. Before going to the next phase, a short discussion 
describing the numerical codes used in the Figures 3 through 7 will be 
presented to assist the reader in interpreting the figures. Each element 
(enclosed in a box) listed in a research subflow contains a numerical 
code. The first digit of this code indicates the subflow number. The 
second digit represents the phase number. And, the third digit indicates 
the step number. If two groups of research activities are specified 
within a given subflow and step, a suffix letter is added to identify 
the two groups. To illustrate this, consider the first block of 
research activities specified in Phase I, Step 1, for the program 
development subflow. The numerical code is 1.1. 1A. This indicates that 
the the "identification of manpower needs 11 falls within the program 
development subflow (1) in Phase I (1-1), in Step 1 0-1-1), and is the 
first (1A) of two areas of research activity specified. 

Contingencies between the research activities are indicated by the 
flow chart lines. Thus, for example, the "inventory present status, 
needs and outcomes of vocational education: 1-1-2" is depicted as being 
dependent upon the identification of manpower needs (1-1-1A) and the 
identification of societal needs (1-1-1B) . When studying the present 
status, needs and outcomes of vocational education the researcher x^ould 
have to be concerned with manpower and societal needs in order to obtain 
data for decisions related to the degree to which the output of present 
vocational - technical programs satisfied manpower and societal needs. 
Similarly, the identification of professional development needs for 
vocational educators (11-1-3) is based on the research in Step 1-1-2, 
inventory present status and needs of vocational education, and on the 
specification of educational needs coming from the research activities in 
Block 1-1-3A, B and C. 



Phase II 



Phase II in the linear array of the research matrix is entitled 
"Systems Design (Planning and Development ) 11 . The objective for Phase II 
is to identify the elements and their relationships involved in improving 
the quality and scope of occupational education, and to use these as a 
basis to design a system to achieve the end goal of the research matrix. 

Five steps are encompassed in this phase. (See Figure 4) The initial 
step is concerned with research directed to refining the variables identified 
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in Phase I and establishing logical and empirical relationships among 
these variables. Formulation of: a decision-making model for the utiliz- 
ation of the research data is the focus of Step 2. Step 3 investigates 
alternative systems and models for developing vocational programs. In 
addition, evaluation and personnel development models are constructed. 

Also, research on alternative learning activities and instructional techniques 
is carried out. The next step. A, is concerned with identifying the 
resources required by each of the systems designed in the prior step. After 
this has been done, research can be initiated to determine the feasibility 
of the alternative systems. The end result of this would be to select a 
system for developing vocational programs and an evaluation system. 

To briefly recap the research activities in Phase I and II, 

Phase I is concerned with a large variety of research activities initiated 
to determine the needs, problems and present status of vocational education r 
In Phase II the data collected in Phase I are refined and utilized in the 
design of several systems or models for vocational program development, 
professional development, and evaluation. By the end of Phase II the 
feasibility of the alternative systems has been determined. 



Phase III 



Phase III shown in Figure 5 is concerned with the development, 
piloting and field testing of sub-systems. The objective identified for 
Phase III is 11 Select and develop sub-systems which will have maximum impact 
on the total system. Pilot, field test and revise until a sub-system is 
ready for implementation. " In the development of the research matrix, 
committee members agreed that time and monetary resources would not be 
sufficient to study and revise the entire system. Hence, this phase was 
designed to foster the development and testing of sub-systems. In addition, 
it suggests the need to investigate procedures for integrating new sub- 
systems with the ongoing system of vocational education. 

This decision was also in agreement with the procedure which evolve! 
for utilization of the total research matrix. The Convergence Technique 
was initially conceived and designed to bring about the solution of a 
major problem which was somewhat fixed in time and scope. The original 
application of the Convergence Technique was in the area of medical research 
where it was used to program research to develop cures for diseases. 

Once an effective cure was found the problem ceased to exist. However, in 
vocational education the problems are not fixed in time and scope. Manpower 
needs change as technology changes. And, societal needs change as jobs are 
phased out, new jobs created, and other social problems arise. As a 
result the committee concluded that the research matrix developed should 
not be conceived as a single program of research activities to attain the 
end goal. Instead, the research matrix was designed so that it could be: 
used in a cyclical manner in which sub-systems would be continuously 
developed, refined and integrated with the ongoing system of vocational 
education as specific needs arose. As new data and techniques become 
available, these would be integrated in the appropriate phases and steps in 
the research matrix and used for further development. Thus, for example, 
on the basis of present research findings, an improved program for handi- 
capped students might be developed and integrated with present vocational 
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education programs. However, as further research data become available 
In Phase I, II and 111, new programs could be developed ard substituted 
for the program originally constructed. 



Phase IV 



Phase IV is concerned with the implementation and integration of the 
sub-system(s) developed in Phase III. The objective for Phase IV is 
"to place the sub-system(s) in operation in the schools and integrate them 
with the total system". Figure 6 presents the steps and subflows contained 
in Phase IV. Six steps were identified for this Phase. The initial step 
is concerned with research focused on distilling an implementation and 
integration model. Steps 2, 3 and A are concerned with selecting implemen- 
tation centers, placing the sub-systems in operation, and evaluating the 
results. In Step 5 the research centers on procedures and techniques for 
revising sub-systems in order to improve their integration in the total 
system. In addition, the evaluation system will be reviewed at this point 
and the results used to improve this system. (This revision process is 
noted by the feedback line which runs from subflow element 2-A-5 back to 
prior phases and steps.) The final step in Phase IV, Step 6, is 
concerned with research on the dissemination of the revised sub-systems. 



Phase V 



Evaluation is the focus of Phase V. The objective for this phase 
is "assess the effectiveness of the system and determine which sub-systems 
lower the performance of the total system. Determine cha validity of 
prior decisions." The steps and sub-flows of research activities in Phase V 
are identified in Figure 7. Three steps were identified for Phase V. 

Step 1 is concerned with evaluating the vocational education system and 
the sub-systems developed in prior phases. In Step 2 the goal is to develop 
dissemination procedures and techniques that will optimize the use of data 
collected in Step 1. The final step, 3, is concerned with assessing the 
effectiveness of the evaluation and dissemination. 



Summary 



The scope of research activities in the research matrix moves from 
the identification of needs in Phase I and narrows in focus in consecutive 
phases to the design of a program development system (Phase II), develop- 
ment and field testing of selected sub-systems (Phase III), implementation 
and integration of the selected sub-systems with total system (Phase IV), 
and concludes the evaluation (Phase V) of the results. As research is 
carried out in successive phases and steps, information related to prior 
research activities will be generated. This is noted In the research 
matrix through the feedback flow-lines. It is also envisioned that more 
than one cycle through the research areas specified in the matrix will 
be made. As new information becomes available through research activities 
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Figure 7: Linear Array - Phase V: Evaluation 



carried out in Wisconsin and in other states, it will he possible to 
further refine the sub-systems and elements in the matrix through addition- 
al resea roll. A graphic outline of the complete research matrix is given 
in Figure 8. 



Relationship of the Research Matrix 
To Specific Research Projects 



The relationship between research problems and elements in the 
Convergence Plan is depicted in Figure 9. Specific research problems fall 
within a research subflow in the research matrix. A particular research 
problem may generate several projects which would be carried out to attain 
the goal for a specific sub-step in the Convergence Plan. As described 
previously, the attainment of the goals for the sub-steps lead to the 
accomplishment of the. goal for the step. 

Since problems are the real world phenomena with which vocational 
educators work, a problem would be the starting point in utilizing the 
research matrix. After a problem has been identified, its location in t lie- 
research matrix can be identified by identifying the subflow, phase, and 
step to which it relates. 



Concurrent and Supplementary Arrays 



Because of the length of time available for the meeting of the 
Matrix Generation Committee, it was not possible to systematically develop 
the concurrent and supplementary arrays. After reviev/ing the output of 
this committee, the Steering Committee recommended that che project not 
attempt to formally identify research activities in the concurrent and 
supplementary arrays. Steering Committee members felt that these arrays 
were important but that they could be developed as attempts were made to 
implement the rest of the research matrix. On the basis of their 
recommendation, the project director did not add the concurrent and supple- 
mentary arrays to the research matrix. 

The following are some examples of research activities that might 
be placed in the concurrent array. 

1. Conceptualization and development of new evaluation systems: 

The development of improved evaluation systems certainly will 
have an impact on the research carried out in the linear array. 
However, considerable information exists on evaluation system*; 
and several workable models exist. Thus, it is not imperative 
that research be initiated in this area. What appears to be 
more relevant is research on the application of existing models 
as specified in the linear array. 
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Figure 9: Relationships Between Phases, Steps, Sub-Flows, 

Research Problems, and Research Projects 



2. Development of new research paradigms and designs for applied 
or action research: Certainly the development of more effective 

applied research techniques and designs would increase the 
productivity of the research in the linear array. Again, 
however, usable techniques are available and appear to be 
sophisticated enough for the research specified in the matrix. 

As described in Chapter 1 the supplementary array involves longer 
term, more high risk research activities. These research activities are 
not directly correlated with any given step in the linear array; furthermore, 
they are generally related to the underlying conceptual structure of the 
discipline being investigated. Some examples of research that might be 
carried out in the supplementary array are: 



1. Nature of psychomotor learning: The development of a more 

sophisticated understanding of psychomotor learning certainly 
would have an impact on several areas in the linear array. 
However, considerable information already exists on psychomotor 
learning and the productivity of research projects in this area 
would probably be relatively low and high cost per unit of 
output. 

2. Design of improved statistical analysis procedures; More 
sophisticated statistical analysis techniques might extract 
more information from the data collected in research studies. 
However, a number of statistical analysis techniques are 
available. And, in most instances they outrun the quality of 
data collected in a majority of research projects. In other 
words, what is needed first is improved data collection 
instruments and techniques. 



During meetings with the Director’s Research Committee, Matrix 
Generation Committee, and the Steering Committee considerable time was 
spent discussing communications in the vocational education research 
community. Because of its mission, all three committees recommended that 
the Wisconsin Research Coordinating Unit (RCU) be the central agency in 
the communications network. The R.C.U. publishes the Quarterly Progress 
Report and Bits About Research and distributes them to vocational educa- 
tors ana researchers in Wisconsin. In addition, the R.C.U. has a library 
of research project reports, both in hard copy and on microform. 

It was suggested that the R.C.U. should involve the following 
institutions and organizations in its communications network; 



Information Flow 



VTAE Institutes 

State Advisory Council on 



University of Wisconsin System 
Vocational Centers at UW - Madison 



Vocational Education 



and UW - Stout 



3.28 



50 



Wisconsin Deportment of 
I’ub 1 ic l instruction 



Private colleges in Wisconsin 
Wisconsin Educational Research 



Loc a 1 Voca t ion a l Ed uca t ion 
Coordinators 



Association 

Other appropriate state agencies 



The matrix and steering committees recommended that each of the 
graduate school deans should receive the R.C.U. communiques. In 
addition, it was recommended that activities be initiated to increase the 
flow of information from all of the agencies mentioned above to the R.C.U. 
Special emphasis was given to the reporting of relevant research studies 
carried out in Master's and advanced graduate programs in the University 
of Wisconsin System and private colleges in Wisconsin. It was the 
consensus of the committee members that not enough is known about the 
research conducted in graduate programs and that graduate student research 
has the potential to make a significant contribution to the solution of 
problems in vocational education. 

In addition to the agencies identified in the list above, the matrix 
and steering committees concluded that there were other state agencies 
that should be included in the communications network. For example, the 
Wisconsin Employment Service and Department of Vocational Rehabilitation 
are conducting activities related to vocational education. Further study 
will have to he conducted to identify all of the agencies and units that 
should be involved in the communications network. 

The committees identified agencies that should be in the communica- 
tions system. However, there will need to he further study of the flow of 
information within each institution. Some of the questions to be resolved 
are (1) to whom should the communiques be addressed; (2) what individuals 
or subunits in an institution need to receive information; and (3) what 
is the communications network within an institution? The cost effective- 
ness of contacting a few or many individuals in an institution will have 
to be studied. 

Communications on research problems and activities related to a 
specific problem or several steps and phases will be aided by the research 
matrix. The flow-lines in the matrix identify relationships between 
various research flows, steps and phases in the research program. In 
addition, the projects attacking the same problem can be identified and 
coordinated. 

The data collected in the research problems survey also provides 
information for the vocational education research community. A computer 
based retrieval system will be developed for the information collected 
in the survey. When this system is completed, anyone interested in a 
specific problem can ask to have a list of vocational educators who are 
concerned with the problem. 



the Steering Committee were research meetings or conferences, meetings 



Some additional ways to stimulate communication and the flow of 
information in the vocational education research community identified by 
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of researchers investigating the same or similar problems, and the design 
of new techniques for communicating research results. 



Resources Flow 



As shown in Figure 8, the resources flow identifies the personnel, 
equipment and facilities, materials, and costs associated with each step 
in the research matrix. Since specific research projects were not identi- 
fied in the linear array, it was not possible to specify the resources 
flow in a definitive manner. This will have to be done on the basis of 
specific projects. Some general concerns and procedures related to specific 
elements in the resources flow are presented in the following sections. 



Personnel 



Several sources of research personnel were identified during the 
project: vocational educators, University of Wisconsin staff members, 

staff members at the two Vocational Centers, graduate students, staff 
members in state agencies, staff members at the private colleges and univer- 
sities in Wisconsin, and retired vocational educators. It is obvious that 
there is a need to identify people who are interested in various research 
areas and who are available to participate in research projects. The 
information from the research problems survey described previously is a 
starting point in this task. 

Another source of researchers and research is graduate students. 

A number of studies relevant to vocational education problems are already 
being investigated by graduate students. However, the output from this 
segment of the research community could be significantly increased through 
the use of the research matrix. More correlated studies could be encouraged 
and students who are presently undertaking problems of moderate or slight: 
interest to them could be encouraged to undertake the investigation of 
problems that are relevant to vocational education. Through the use of the 
information collected in the problems survey, graduate students coulcl 
be directed to vocational educators who are very familiar with the problem 
to be investigated. These vocational educators* could serve on an advisory 
committee or in an advisory capacity. As a result, the graduate student 
researcher could produce relevant research results, and would become more 
familiar with vocational - technical education in Wisconsin. 

As personnel are identified and encouraged to undertake various 
research activities, studies should be made of the productivity of various 
research staffing plans. Two contrasting plans, for example, are (1) select 
professional researchers to conduct the studies, versus (2) select voca- 
tional educators with an interest and some proficiency in research to 
conduct the studies. In the latter case the professional researcher could 
serve as a consultant and resource person. The writer*s concern with the 
first staffing plan is that the results of the research would tend to 
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remain with the researcher and would not be fully disseminated to voca- 
tional educators. If the researcher is a vocational educator, he can make 
direct and immediate application of the research results. Thus, various 
staffing combinations including vocational educators and vocational 
researchers for research projects should be studied to determine the 
optimum staffing plan in relation to research productivi ty and dissemination. 



Equipment and Facilities 

Specification of equipment and facilities would depend upon the 
specific research projects developed in each step. Although specific needs 
may arise, extensive equipment facilities and resources exist throughout 
the state. A variety of instructional environments are in use in vocational 
technical programs. Several vocational - technical schools have advanced 
multi-media instructional systems. In addition, the university campuses 
have equipment and facilities appropriate for research. For example, in 
the fall of 1972, the Vocational Center at the University of Wisconsin - 
Stout will have access to a new applied research facility. This facility 
contains an information processing area, instructional research lab, and 
instructional media development area. The instructional research lab 
contains equipment which can be used to simulate industrial processes. This 
lab was designed for flexibility with all the utilities servicing the 
equipment placed under the raised computer-style floor. 



Materials 



As with the prior arrays in the resources flow, the materials require* 
will depend upon the research activity initiated. A number of resources 
exist in this area and a part of the task of the research project directors 
and the coordinators of the research plan will be to make effective utiliz- 
ation of existing materials. 



Co«r 



This element will no doubt be a limiting factor as funds for research 
are limited. This makes it very important that the cost effectiveness and 
cost benefits of each of the proposed research projects be considered. 
Moreover, the effective use of research time and effort will also have 
an impact on cost. Thus, it is critical that effective management be 
exercised. Also, a variety of sources of funds should be sought for 
implementing the research matrix. 



Utilization of the Products of the Convergence Pr oject 

Two major products resulted from the activities conducted in the 
Convergence Project. To a degree they can be applied separately. 
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However, maximum effectiveness will be achieved yhcn they are used in 
concert. ,> 



Research Problems Survey Results 

Results of the problems survey can be used in several ways. The 
medians and inter-quar tile ranges presented for each population in the 
survey can be used to identify the critical problems faced by vocational 
educators. A study of the research priorities assigned by the responders 
provides a basis for stimulating research and allocating research resources. 
In addition, the problems identified by the responder on the survey form 
(written in) can be used to identify unique problems faced by some voca- 
tional educators. Consideration should also be given to these as a revised 
survey instrument is developed in future years. 

The survey responses have been punched on tab cards along with the 
responders title and school. Thus, it is possible to sort on a specific 
problem in the survey and identify vocational educators who are concerned 
with the problem in question. Use of this information system will allow 
researchers to identify resource people and possible tryout sites for 
their studies. 

The data provided by the responders can also be used as a task 
analysis by individuals who are concerned with the pre-service and in- 
service preparation of personnel for the vocational education systems 
in Wisconsin. Thus, when one notes that the identification of manpower is 
the critical problem this suggests that the programs preparing research 
and planning administrators should contain educational experiences related 
to this area. In addition, in-service experiences could be structured 
for this task. 



Research Matrix 



The most direct application of the Convergence Plan is in the 
development and administration of a coordinated program of vocational 
research. Analysis of the linear research array presented in Figures 3 
through 7 and the results of the research problems survey provide an 
indication of the research needed in vocational education. The 
convergence research matrix also assists in establishing more effective 
communications and utilization of resources in the vocational research 
community. 

As mentioned in the section describing the development of the 
research matrix, prior research or research in progress was not consider 
when the elements in tne matrix were identified. Thus, in some sub-steps 
the primary activity may be synthesis of existing research related to the 
problem areas specified. In many instances however, the problem area will 
require additional research. The research matrix will be an invaluable 
tool in identifying needed research and the possible relationship between, 
this research and other research problems in the matrix. 
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Identification of the correlation between various research problem 
areas will assist -the researcher in the design of his study. This will 
also assist in the establishment of appropriate communication channels 
within the vocational research community. As* depicted in Figure 9 in many 
instances several research projects will be undertaken in a specific 
problem area. The. research matrix will assist in coordinating these studies 
also. Both in the* case of the related research areas which cut across 
steps and. .phases in the research matrix and research projects attacking the 
same problem, there is a need to design the studies and research instruments 
involved so that the results of individual projects can be compared and 
synthesized. If this is not done, the present problem of many relatively 
small research projects with little or no relationship to each other will 
continue to exist. 

The research matrix developed in this study should help to coordinate 
vocational research. The phases, steps and flows within the matrix identify 
relationships and contingencies. The research problems survey data provide 
an indication of the magnitude and priorities in various problem areas 
within the matrix. Researchers can use this information to select relevant* 
and critical areas of research in vocational education. (The data from 
the research problems survey has already been used in establishing research 
priorities for the VTAE system for 1972-73.) The research matrix also 
provides a means for inventorying research completed and in progress. This 
will assist in the task of identifying areas that need additional research. 
The matrix is also heuristic in that it suggests areas of research which 
may not have been considered before by vocational researchers. 

The following example illustrates the application or use of the 
research matrix in development of research. The specific area to be 
studied in this example is 11-1-3: "Identify Professional Development 

Needs" . One or more research projects might be initiated to attain this 
goal. For example, one might survey vocational educators to determine 
their perception of what they need in order to effectively perform their 
jobs. Also, one might conduct an experimental study comparing two 
treatments each containing different professional skills. In planning 
both of these studies, the research matrix indicates that consideration 
be given the present status, needs, and output of the vocational educatio n 
system (1-1-2). Research on present status and needs of vocational 
education, moreover, is based on the manpower and societal need*; in the 
region or state. In addition. Step 3 in the instruction and program 
development subflow specifies research related to identifying pre-employ- 
ment, upgrading, and retraining needs (1-1-3A,B&C) . As denoted by the 
flow line in Figure 3 connecting elements 1-1-3 and 1 L— 1-3 , individuals 
investigating professional development needs will have to maintain liaison 
with the research carried on in the program development area (subflow 1). 

The previous paragraphs have suggested several applications of the 
products of this study. These and similar applications are important to 
the long-range impact of this study. Only through a concerted effort to 
utilize the research matrix and the survey data will evidence be 
accumulated on their validity. In addition, procedures need to be 
developed for using the research matrix through actual experiences with 
its application. ~ „ 
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Chapter IV 



i 

CONCLUSIONS AND RECOMMENDATIONS 



Conclusions 



1 



The following conclusions were developed on the basis of the 
research activities completed in this project. 

1. On the basis of the high response rate to the research 
problems survey, there appears to be considerable interest 
in research on the part of vocational educators in 
Wisconsin. 

2. The problems survey data provide a valid picture of major 
problem areas and should be used in identifying research 
projects. In addition, teacher educators can use the 
information in planning their programs. 

3. The Convergence Technique can be applied to planning 
vocational research programs. 

A. The research matrix developed in this study can be of 
value in establishing a coordinated program of 
vocational research in Wisconsin. 



Recommendations 

1. Results from the research problems survey should be used in planning 
research efforts. 

2. An attempt should be made to utilize the survey results in identifying 
pre- and in-service professional development needs. 

3. The research matrix developed in this study should be validated 
through application to vocational education research in Wisconsin. 

3.1 Recently completed research and research in progress should be 
identified with the appropriate step in the research matrix. 

3.2 Results of Step 3.1 should be used in establishing the 
information flow. 

3.3 A synthesis of the research results related to Phase I in the 
matrix should be undertaken. 

3. A Systematic identification of the resources available for research 
needs to be initiated. 
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4. An expanded communications system for the vocational research 
community should be established through the R.C.U. 

5. As experience is gained in using the research macrix, the con- 
current and supplementary research arrays should be developed. 

6. After one year the status of research and the research matrix must 
be reviewed. This process needs to be carried out annually. 



4.2 
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70. Assessing the influence of student clubs on the 
professional and social developnent of students 
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97. Developing better teaching methods 
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111, Identifying career decision-making procedures 
that lead to valid career selections on the 
part of students 
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Results of Research Problems Survey 
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The response choices for this item were inadvertently left oft the form. 
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DPI and LVEC Responses to Convergence Problems 
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PROBLEMS IDENTIFIED BY RESPONDERS 
(Write-In Problems) 



Item No* A 



VTAE Research a Planning Administrators: 
In Agri Area only 



Item No. 6 



VTAE Research & Planning Administrators: 

Define Number of female-male ready for industry course 

by each industry development unit - with or without training 

WBVTAE Staff: 

Student Financial Aids 
Dynamics of certain markets 

Determining present output in VTAE of DPI, U. of W. System, 
Private schools, etc. 



LVEC 1 s : 

Determine effectiveness of programs 
Job entry positions 
K-12 Career Development 
Part-time jobs for co-op students 

Determining number of similar programs training for the same 
core of jobs in the same geographic area 
The problem in Central & North Central Wisconsin is not 

enough jobs area available to accommodate the trained work 
force we already have 
Identifying all entry level jobs 

Survey and review of new job titles presently evolving and in 
recent years 

Determining geography of job market 

Demonstrate to the state of Wisconsin the need for more money 
to be put into vocational education 
Statewide occupational survey for job clusters for visually 
impaired and blind. 



Item No. 7 

WBVTAE Staff: 

Recruitment, orientation, encouragement of dropouts and 
alienated persons for persons with special needs 
Emerging jobs and market readiness 

LVEC’s: 

Skills needed at job entry level 

Student - teacher relationship 

Jobs for special ed. students 

Coordinating Manpower Data WSES - VTAE - Local 
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Item No, 7 Cont. 



DPI: 

Determine what employers would like in entry level employees 
compared with urgent entrance requirements in marketing and 
distribution 



Item No. 8 



VTAE Research & Planning Administrators: 

Identify number of employed from counties 



WBVTAZ Staff 

Remedial, Tutoring, Coaching services for physically handicapped 



Item No. 9 



LVEC's: 

Reading and interpreting services 

How new jobs evolve and methods of teaching job transfer 



Item No. 10 



VTAE Research & Planning Administrators: 

Determine value of WSES Outreach to serve in job placement and 
training referral in mileage problem 

WBVTAE Staff: 

Special job placement services for the handicapped and disadvan- 
taged 



Item No, 16 



VTAE Directors: 

Nursing 

VTAE Instructional Services Administrators: s 

Short courses of less than semester length to meet immediate 
needs of small industries 
Dental hygiene 
A.D. Nursing 
NLN 

Rad iologica 1 technology 

VTAE Research & Planning Administrators: 

L.P.N. 

Cosmetology 
Dental Assistant 
Dental Hygiene 
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Item No. 16 Cont. 



VTAK Research & Planning Administrators Cont. 

Health Programs 
Health 

Health Occupations 
A.D. Nursing 
Radiology Tech. 

Plan Para-medical and Health Centers 
P.N. 

Physical Therapy 
Air and Power 

WBVTAE Staff: 

H.O.E. program courses 
AMA - Council on Med. Edu. 

ADA - Council on Dental Edu. 

Div. of Nursing and Board of Regents 

State aid distribution policy 

Fiscal year standardization 

Uniform accounting system 

Program accountability *Q (high priority) 

Role of district boards 
Facilities 

Circuit relations program management 
Full year district operation 
Quarterly system and VTAE 
Career development - adult 
Professional development of all personnel 

LVEC 1 s : 

Data Processing 
Health Careers 
Health Occupations 

Health services area - not educ. agencies but health agency 

Programs for health care 

Health 

Health Fields - Trades 

Health, Labor Unions, Industrial Commission 

Health Services 

Career education 

Supervised job training 

Music instrument repair 

Art-creative 

Approval 

Voc . -Tech . schools 
Special short voc. courses 
Relevance of given accredition 
Power mechanics 
Metal lab 
Vo - ag 

Clerical and secretarial 
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Item No * 16 Cont* 



LVEC’s Cont,: 

DPI - voc programs 
North Central Accredit* 

Commerical art 
Building trades vs* unions 
Building trades 
Graphics 

Articulate with MATC , VTAE, District 9 
VTAE 9 - Wis * DPI 

I’m thinking of: Could students get graduate credit for 

individual or independent study courses toward college 
graduation 



DPI: 

Distributive education - not accepted - North Central Association 
Steering Committee: 

Satisfying AACSB programs vs* Business Education employment needs 



Item No* 29 



VTAE Research & Planning Administrators: 

Program planning with Minnesota schools based on job market need 
in Wisconsin and Minnesota 

Determine the validity of the "Ladder 11 Approach to occupational 
education 

WBVTAE Staff: 

Articulating with employers 
Open education 

LVEC 1 s : 

Developing predictive devices to the use in selecting successful 
instructors 

Identifying by age 12, the students who will not be successful 
in the general education curriculum 
Get all teachers motivated to do curriculum work on behavioral 
obj ectives 

Possibility of central school vs. scattered satellite schools 
Developing job descriptions of school activities 
Articulating academic courses with vocational courses 



Item No* 30 



VTAE Research & Planning Administrators: 

Program application procedures with Upper Great Lakes Regional 
Commission 
Ed* technology 
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Item No. 31 



VTAE Research & Planning Administrators: 

Special programs for handicapped residents 



Item No. 32 



VTAE Research & Planning Administrators: 

Shifting of Voc. Tech. Programs to the comprehensive high 
level for post-secondary program. 



Item No. 33 

VTAE Research & Planning Administrators: 

Program planning for a study skills center 

Item No. 41 

VTAE Research & Planning Administrators: 

Developing testing out packages for advanced standing 



Retooling teachers to the above 

Lack of good AV Dept. 

Assessment of relative effectiveness of lf successf ul" instructional 
methods 

Developing strategies for implementing new ideas (guides, 
activities, etc.) into the curriculum 

Provide learning materials that directly relate to industrial 
setting . 

Using behavioral objectives effectively. 

DPI: 

Determine effectiveness of learning manager approach 



Determination and use of task analysis 

Determine effectiveness of individually designed learning 

activity packages around each student T s career objectives and 
used in a group situation. (The interstate D.E. Curriculum 
Learning Activity Packages will be ready by fall of *72.) 



LVEC 1 s : 

Converting from group instruction to individualized instruction 



LVEC * * : 



Iten No. 42 



LVEC 1 s : 



Item No. 43 
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Item No. A A 



LVEC 1 s : 

Organization of team teaching contract teaching 



Item No. 5A 



VTAE Instructional Services Administrators: 

Developing criteria for teacher selection attitudes, performance, 
prediction, etc. 

VTAE Research & Planning Administrators: 

Develop a model for career salary planning for certified 
employees using merit. 



LVEC f s : 

Defining M career development 11 
Teacher evaluation 

Students must know what they want. We can f t force them to learn. 
Useful material 

Utilizing community in evaluation 
Career development 



DPI 

Determine effectiveness of "met standard 11 grading and evaluation 
(See I.D.E.C.) 



Item No . 55 



VTAE Research & Planning Administrators: 

Develop a model for merit plan for cleric employees 



DPI: 

Evaluate my job satisfaction as well as job satisfaction 



Item No. 56 



VTAE Research & Planning Administrators: 

Measure dual industry support for hiring the vocational trained 
student 



Item No . 63 



VTAE Student Services Administrators: 

Identifying job specialists graduates of voc. tech. 
Determine needs of workers for upward mobility in marketing 
especially 
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Item No. 63 Cont. 



Identifying student "maturation" change factors 
Somewhere in here needs to be research on where non-college 
bound people live and work to determine relevance of 
programs — critical. 



Item No. 73 



VTAE Research & Planning Administrators: 

Redefining role of student services 

Design a faculty advisor model for use in voc-tech faculty 
assignments 

VTAE Student Services Administrators: 

Relating personnel counseling to academic success 



LVEC ' s : 

Developing career development continuity K-12 

Especially jobs available with state and federal departments 
(agencies). Always too much red tape — they say — can't work 
for the forestry, SCS, ASC, federal Land Bank, county or state 
department and they should be the ones helping in giving the 
student work experience. 

Centralized U.S. Dept. Student Services set-up implementing voc. 
guidance & counseling 



Item No. 74 



VTAE Student Services Administrators: 

Obtaining more SPS staff 
Transfer credit 

Assess effectiveness of priority supported mental health centers 
LVEC ' s : 

Money is the problem! 

Item No. 75 



VTAE Student Services Administrators: 

Determining administrative reasons for SPS negativisms 
Total student development providing educational opportunity for 
the total human being - not just vocational 

Item No. 76 



VTAE Student Services Administrators: 

Identifying innovative ways of obtaining total admin, support for 
SPS functions in a modern tech- institute 
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Item No. 82 



VTAE Research & Planning Administrators: 

Study transportation need 

VTAE Student Services Administrators: 

Study to show how the black disadvantaged have been provided 
for as compared to what has been done for the white 
disadvantaged 

Providing increased financial aids for disadvantaged students 
Ways to convince the present administration about the needs 
of the areas disadvantaged population 



WBVTAE Staff: 

Technique for motivating disadvantaged 
Programs and services for handicapped 

LVEC 1 s : 

Developing procedures for identification of disadvantaged students 
Relating voc. ed. teacher education to these needs 
Identification of individuals are really disadvantaged and/or 
handicapped other than the criteria as set forth by the U.S. 
Office of Education — with only a mild stretch of the imagina- 
tion almost any student could qualify as disadvantaged or 
handicapped - Also we do not address the multiple handicapped 
student as much as we could. 

Perhaps the greatest problem in our secondary schools is a lack 
of quality programs for the disadvantaged and handicapped 



Item No . 83 



VTAE Research & Planning Administrators: 

Study fiscal need for student sides 

WBVTAE Staff: 

Collateral services to enable participation of disadvantaged 
Effective learning activities and materials for handicapped 



Item No. 91 



VTAE Research & Planning Administrators: 
Study transportation need 



WBVTAE Staff: 

Selecting and training staff for handicapped 
LVEC 1 s : 

Should have work experience program 

Identifying school district or counties for programs geared to 
meet these needs 
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Item No. 91 Cont. 
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LVEC'ss 

Programs for potential drop-outs 

Prisoners of county jail training programs at our H.S. 
Relating voc. ed. teacher ed. to these needs 



Item No . 92 



VTAE Research & Planning Administrators: 

Study fiscal need for white student aids 

LVEC's: 

Re-evaluating programs for functional drop-outs (physically in 
school but accomplishing nothing) 



Item No . 103 



LVEC’s: 

Provide courses for humanizing teaching 



Item No. 104 



VTAE Research & Planning Administrators: 

Develop an effective in-service program for clerical employees 

LVEC's: 

Re-evaluating curriculum to eliminate extraneous courses and 
material. 

For disadvantaged instruction 

Flexibility in use of experienced personnel in programs which do 
not. have degrees 

Teacher organization need help (JEA) 

Quality control for off-campus UW courses 

Item No. 105 



VTAE Research & Planning Administrators: 

Develop a model for merit growth of all employees 

LVEC's: 

For "handicapped" instruction 



Item No. 113 

VTAE Research & Planning Administrators: 

Define career education in terms of equipment and teaching 
materials needed in trades — start developing program in high 
school 
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Item No. 113 Cont. 



VTAE Student Services Administrators: 

Program of veteran recruitment 

Designing a four year career education program: ll.S. Jr. thru - 

post high two year program * 4 years 
Possible change in attitude toward vocational (prestige, etc.) 

LVEC's: 

Converting from group instruction to individuzlized instruction 



WBVTAE Staff: 

Methods to accomplish articulation 
LVEC's: 

Evaluation procedures 

Administration inservice on career education with prominent 
M believers ,f 
Implementation 

Teacher inservice career education 

Job description of who is responsible for career education 
Developing a very effective K-12 career education development 
program 

Teacher education for career education 



Item No. 11A 



VTAE Student Services Administrators: 
Credit compensations for veterans 



WBVTAE Staff: 

Promotion of acceptance of career education with traditionalist 



LVEC's: 

Techniques on how special funding can be achieved for career 
education 
Staff inservice 

Survey how mu~h integration is presently being done 
Career education resource materials 



Item No. 115 



Anonymous : 

Community information concerning career ed. 



Item No. 116 



LVEC's: 

Implementation of guidance 
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Item No. 122 



WBVTAE Staff: 

Identifying the responsibilities of the administrators 
LVEC's: 

The LVEC reporting directly to the superintendent and advising 
the principal and directors of instruction instead of having 
the LVEC report to principal in H.S. matters and director of 
instruction on district matters 

Roles and relationships of LVEC 



Item No. 124 
WBVTAE Staff: 

Administrators acceptance of education objectives 



Item No. 132 



VTAE Instructional Services Administrators: 

Obtaining research data for new innovative techniques for 
facility planning 

WBVTAE Staff: 

Utilizing and developing action research in educational process 
LVEC's: 

Determining research needed. 



Item No. 144 

WBVTAE Staff: 

Project proposal writing 



Item No. 153 



VTAE Research and Planning Administrators: 

Determine the relationship between physical environment and 
student achievement 



LVEC ' s : 

Need more storage space 



Item No. 154 



VTAE Research and Planning Administrators: 

Determine facility needs of new instructional methods 
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Item No. 154 Cont. 



LVEC ' s : 

Schools sharing programs, some are in operation 



Item No. 164 



LVEC ' s : 

Revise and evaluate long range plans 



Item No. 165 
LVEC ' s : 

Keeping an inventory 



Item No. 171 



LVEC ' s : 

Need to understand the community needs of the people 
Printed material covering P.R. 



Item No. 173 



LVEC ' s : 

Anything on behavioral objectives, I marked research immediately 
because we are supposed to be developing them and have them done 
within the next year. 



Appendix E 



May 23 Steering Committee Meeting 
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MAY 23 STEERING COMMITTEE MEETING 



I. Initial Activities 

A. Welcome participants 

B. Distribute expense voucher forms 
II. Review the Objectives of the Project 

A. Identify major problems faced by Vocational Education 
in Wisconsin (Visual) 

B. Determine the overall goals for a convergence plan for 
research 



III. 



T 



C. Identify the relationships between these goals and the 
priorities for attaining these goals 



D, 



Construct the convergence research plan 



E, Determine the feasibility of implementing the convergence 
plan 

Review Convergence Approach 

A, Page the article - handout extra copies if needed 
B« Bring out the following points 



1 . 


p. 422* 


- Benefits of a planned research program . 


2. 


p. 423 


- Criteria for planning technique 




3. 


p . 423 


- General concept 




4. 


p. 424 


- Basic proposition 




5. 


p. 4 ?.4 


- Idea of convergence 




6. 


p. 425 


- Define terms in the chart - see p. 
definitions 


430 for 


7. 


pp. 425- 


-428 - Sample charts 




8. 


Formulating program objective and developing 
logic system f 


the general 



*Page numbers refer to Carrese and Baker, 1967 
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a. Selection of major goals and sub-goals 

b. Development of the logic system 

9. We are meeting for less time. However, this is a start. 

I envision more meetings in coming year. 

10. Procedure 

a. Determine overall goals 

b. Determine research logic (system) 

c. Develop linear assay (research flow) 

(1) Determine phases and their sequence 

(2) Determine steps (emphasize definition - not a 
step in a project) (defined in objectives) 

(3) Determine projects (or activities) (defined in 
terms of specific research) 

d. Determine concurrent and supplementary assays 

e. Define the information flow 

f. Include decision points (See p. 434) 

g. Transfer logic matrix into an operational program 
plan (to p. 435) 

h. Review of research activities - p. 435 

C. Select overall goal(s) to converge or "more effective delivery 
of quality vocational education to ail Wisconsin Citizens who 
can profit from it." 

D. What are the problems (barriers) to achieving this goal? 

IV. Review the major activities initiated 

A. Presentation to director's research committee - October 

B. Meeting with the steering committee October 29, 1971 (this 
group) 

C. Visits and discussions with Assistant Directors for Research 
and Planning and Instructional Services in each VTAE school 
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!)• Contacts with LVEC's who contacted the Center for Vocational, 
Technical and Adult Education 

E. Review of literature to distill additional problems 
1 . Professional .journals 

2. Research reports 

3. Research newsletters, etc. 

F. Each problem was placed on a A x 6 card and used, to develop the 
survey instrument you received 

G. Vocational Education problems survey conducted (VTAE, LVEC, 

DPI, Steering Committee, and WBVTAE) 

H. Input to Directors Research Committee - decisions on recom- 
mended priorities 

1. Sub-committee (March 30) 

2. Committee (April 12) 

I. Matrix Committee - April 18, 19, 20 (Ruel Falk, Rollie Krogstad, 
Mehar Arora, Allan May, and Warren Leonard) 

J. Di.scussions and actions of Matrix Committee summarized and 
placed in graphic form 

K. Today's meeting: Purposes 

1. Review the work done on the project 

2. Study and comment on the research matrix 

3. Suggest modifications and additions 

4. Suggest further action 

V. Discuss the summary statistics in Tables A, B, and C from the 
Convergence Survey form (Hand out extra forms if needed) 



! 

I 



A. Survey was used to validate problems and obtain suggested 
priorities 



B. Q Statistics 




2 . Q 1 
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4. IQR - measure of agreement 
Note the groups and sizes (N) in survey 

D. Look at frequency of various Q2 and P values 

E. Identify major problems for each group 

F. Survey results substantiate that program development to meet 
the needs of students and industry is of central concern to 
vocational educators 

VI. Based on the results of the surve- the general logic system or 

framework for the research program was developed (Show Fig. 1 O.T.) 

A. Program development to meet student and societal needs is 
central activity 

B. (Briefly discuss each element and the flow) 

C. Tie this in with flow 1 in the research matrix 

VII. Overall Research Matrix 

A. Define the major flows - research, information, and resources 
(O.T.) 

B. Identify the phases - hand out dittoed sheet 

VIII. Go to Phase I (O.T.) 

A. Review definition 

B. Define steps and relate to general logic system. Note that 

the lines between phases and steps are not hard and fast. Also, 
this is not a network that requires completion of all prior 

activities before undertaking a later activity. 

* 

C. Relate the several documents 

1. General logic diagram (determine needs) 

2. Phase I (identification and analysis of needs) 

3. Step 1 (also 2 and 3) (identify needs) 

Research problems (see survey form) 
a. Magnitude of manpower needs - 1, 2, 3 



4 . 



I>. 



Magnitude of social needs - 1, A, 59, 78, 88 
Integration - 5 



c . 



5. Research projects - a problem may lead to several research 
pro j ects: 

Example: 

Phase I 

Step 1 

Flow I-1-1A: Identify manpower needs 

Projects: (1) Determine validity of WSES data 

(2) Determine potential of newspaper 
ads as indicators of manpower 
needs 

(3) Student location on first job 
as indice of manpower needs 

(A) Geographical area to be used in 
projecting manpower needs 

i. Review Contents of Flows in Linear Assay 

A. Flow 1 (core flow) 

B. Remaining flows 

C. Note the flowback of information 

D. The lines connecting blocks show contingencies 

1. Dependencies in planning research 

2. Prior research required 

3. Need for information exchange 

E. Note that this would be a recycle process, i.e., more than 
once thru 

X. Review the Other Flows (discuss contents) 

A. Concurrent 

B. Supplementary 
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C. Information 



1. Problem and people retrieval 
D. Resources 

1. Personnel (note retrieval system) 

2 . Cos t 

3. Materials 

A. Equipment and facilities 
XI. Discuss Future Actions 

A. Use of research matrix 

B. Further development 
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